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Abstract 



CO " In this paper we consider a collection of single-antenna ground nodes communicating with a multi- 

antenna unmanned aerial vehicle (UAV) over a multiple-access ground-to-air wireless communications 



link. The UAV uses beamforming to mitigate the inter-user interference and achieve spatial division 
multiple access (SDMA). First, we consider a simple scenario with two static ground nodes and 



analytically investigate the effect of the UAV heading on the system sum rate. We then study a more 
general setting with multiple mobile ground-based terminals, and develop an algorithm for dynamically 
adjusting the UAV heading in order to maximize a lower bound on the ergodic sum rate of the uplink 
channel, using a Kalman filter to track the positions of the mobile ground nodes. Fairness among the 
users can be guaranteed through weighting the bound for each user's ergodic rate with a factor inversely 
proportional to their average data rate. For the common scenario where a high if -factor channel exists 
between the ground nodes and UAV, we use an asymptotic analysis to find simplified versions of the 
algorithm for low and high SNR. We present simulation results that demonstrate the benefits of adapting 
the UAV heading in order to optimize the uplink communications performance. The simulation results 
also show that the simplified algorithms perform near-optimal performance. 

Index Terms 

UAV communication networks, UAV relays, UAV positioning, interference mitigation, beamforming 
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I. Introduction 
A. Background 

There is increasing interest in the use of relatively small, flexible unmanned aerial vehicles 
(UAVs) that fly at lower altitudes for providing relay services for mobile ad hoc networks 
with ground-based communication nodes Q]|-[l8]|. We consider such an application in this paper, 
assuming a system with a multi-antenna unmanned aerial vehicle (UAV) flying over a collection 
of N single- antenna mobile ground nodes. The UAV acts as a decode-and-forward relay, sending 
the messages from the co-channel users on the ground to some remote base station. The goal is 
to control the motion of the UAV so as to optimize the uplink communications performance. 

A number of different approaches have been proposed in the literature to address the perfor- 
mance of UAV-assisted communication networks. For example, in JTJ, a throughput maximization 
protocol for non-real time applications was proposed for a network with UAV relays in which 
the UAV first loads data from the source node and then flies to the destination node to deliver 
it. The authors in [2] investigated different metrics for ad hoc network connectivity and propose 
several approaches for improving the connectivity through deployment of a UAV. In fl3], the 
authors considered a scenario in which multiple UAVs are deployed to relay data from isolated 
ground sensors to a base station, and an algorithm was proposed to maintain the connectivity of 
the links between the sensors and base station. 

The work described above assumes that the ground nodes are static and that the UAV is 
configured with only a single antenna. Given the well-known benefits of employing multiple 
antennas for communications, it is natural to consider the advantages they offer for UAV-based 
platforms [9|. The measurement results of iflOl showed that using multiple receivers at the UAV 
can significantly increase the packet delivery rate of the ground-to-air link. A swarm of single 
antenna UAVs were used as a virtual antenna array to relay data from a fixed ad hoc network 
on the ground in flU, and the performance of distributed orthogonal space-time block codes 
(OSTBC) and beamforming were evaluated. A relay system with multi-antenna UAVs and multi- 
antenna mobile ground terminals was investigated in [5]. The users employ OSTBC to transmit 
data and the data transmissions are assumed to be interference free. Based on estimates of the 
user terminals' future position, a heading optimization approach was proposed that maximizes 
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the uplink sum rate of the network under the constraint that each user's rate is above a given 
threshold. The restriction of flU to the interference-free case is a significant drawback, which we 
address in this paper. An earlier version of our work [fTTTl discussed the use of an antenna array 
to improve the throughput of the ground-to-air uplink when the users share the same channel 
and interfere with one another. 

B. General Approach and Contribution 

In this paper, we consider a model similar to JH, with several ground-based users commu- 
nicating simultaneously with a multi-antenna UAV. The main difference with [[5]| is that we 
assume there exists co-channel interference between the different users' data streams. The users 
are assumed to transmit data with a single antenna and the UAV uses beamforming to separate 
the co-channel data streams. We assume a correlated Rician fading channel model between each 
ground node and the UAV, and we use a lower bound on the ergodic achievable rate to quantify 
the uplink performance of the relay network, assuming that the UAV uses a maximum signal- 
to-interference-plus-noise ratio (SINR) beamformer for interference mitigation. The strength of 
the mutual interference depends on the correlation between the users' channel vectors, which 
in a high ^-factor channel is a function of the signals' angle of arrival (AoA). The AoAs 
depend in turn on the UAV's heading and the relative positions of the UAV and the ground 
nodes. Consequently, we propose an adaptive algorithm for adjusting the heading of the UAV to 
minimize the users' mutual interference and improve the uplink communications performance. 
In particular, the UAV is assumed to fly with a constant velocity v u , and it adjusts its heading 
in discrete time steps (assuming a constraint on the maximum turn rate) in order to optimize the 
bound on the achievable rate. At time step n, the UAV uses a Kalman filter driven by feedback 
from the ground terminals to predict their positions at time n + 1, and then the UAV computes 
its heading in order to optimize the bound based on these future position estimates. 
The main results of this paper are summarized as follows: 

1) We analyze the trajectory optimization problem for a special case involving two static 
ground nodes. We use a rectangular-path model to characterize the UAV's trajectory, which 
reduces the problem to one of optimizing only the heading. This problem can be solved 
using a simple line search, and the results indicate how increasing the size of the UAV 
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array can reduce the system's sensitivity to the heading direction. 

2) For the case of a general network of mobile ground-based nodes, we derive a lower bound 
on the average achievable sum rate to measure the system performance. Based on this lower 
bound, we formulate a heading optimization problem and propose a line-search algorithm 
to adjust the UAV's heading direction at time step n such that the system performance at 
time step n+1 can be optimized. We study the performance of both time-division multiple 
access (TDMA) and space-division multiple access (SDMA), and illustrate via simulation 
the dramatic improvement offered by SDMA. 

3) We derive asymptotic analytical results for the heading optimization problem under the 
assumption of a high ^-factor Rician channel between the ground nodes and UAV. The 
asymptotic results provide simplified methods for solving the heading optimization prob- 
lem. A separate approximation method is used for low and high SNR cases, and we show 
that using the asymptotic expressions for heading optimization results in performance 
nearly identical to that of the optimal algorithm. 

C. Organization 

The organization of the paper is as follows. We present our assumed signal and channel model 
in Section UH and in Section [TIT] we focus on the UAV heading optimization problem for the 
special case of two static ground users. In Section |IVl we first describe the mobility model 
for the UAV and ground nodes, as well as a standard Kalman filter for predicting the future 
positions of the ground nodes. Then we formulate the UAV heading optimization problem and 
propose an adaptive heading adjustment algorithm. We then derive asymptotic expressions for 
the general heading optimization problem in Section |V] assuming a high-f^ factor Rician channel 
between the UAV and ground nodes. Simulation results are provided in Section |VI] to illustrate 
the performance of the heading control algorithm, the advantage of SDMA over TDMA, and 
the validity of the asymptotic results. 
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II. System Model 

A. Signal Model 

We assume a UAV configured with an array of M antennas, and a collection of N ground 
nodes each equipped with a single antenna. We restrict attention to non-hovering UAVs that 
must maintain a certain forward velocity to remain airborne. We assume that, during the period 
of time in which the UAV is receiving uplink data from the ground nodes, the UAV maintains a 
constant altitude h u and a constant velocity v u . For simplicity, we assume that each ground node 
transmits with the same power P t , but this assumption is easily relaxed. The signal received at 
the UAV array at time n can thus be written as 

N 

Yn = ^ \fPt\nXi,n + n n , (1) 

i=l 

where h in E C Mxl is the channel vector between node i and the UAV, the data symbol x^ n is a 
complex scalar with zero mean and unit magnitude, n G C Mxl is zero-mean additive Gaussian 
noise with covariance E{n n n^} = a 2 l M , and I M denotes an M x M identity matrix. The UAV 
isolates the data from the ith node by multiplying y n with a beamformer w in . As such, we 
assume that the number of active uplink users is less than the number of antennas, or N < M. 
Assuming the channels h in ,z = 1, . . . , N are known to the UAV {e.g., via training data from 
the ground nodes), the vector Wj n that maximizes the signal-to-interference-plus-noise ratio 
SINR i:n is given by OH 

Wi,„ = Q^nKn , (2) 

where Q in = J2j=i jy* ^hj.nhjfn + a2 ^-M- The corresponding SINR i:n can be calculated as 

SINR hn = P t h^ n Q-^h hn . (3) 

B. Channel Model 

We assume a correlated Rician fading channel between each user node and the UAV with 
consideration of large-scale path loss: 

Kn = ^, (4) 

u i,n 
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where h^ n is the normalized channel vector, d i:Tl is the distance between node i and the UAV 
during the nth time step, and a is the path loss exponent. Define the three dimensional coordinates 
of the UAV and node i as (x un , y u>n , h u ) and (xi n , y^ n , 0), so that d in is given by 



(^i,n \l \%u,n •>"i,n) ' \i/w,n yi,n) T" " u - \P) 

For node i, we write the Rician fading channel vector h in with two components lfl3l . a 
line-of-sight (LOS) component hj n and a Rayleigh fading component h in : 

\i in = h i>n + hi >n . (6) 

The LOS response will depend on the AoA of the signal, which in turn depends on the heading 
of the UAV (determining the orientation of the array) and the positions of the UAV and user 
nodes. For example, assume a uniform linear array (ULA) with antennas separated by one-half 
wavelength, and that at time step n the phase delay between adjacent antenna elements for the 
signal from the ith node is p ijU , then the LOS component could be modeled as 



hn = \j^ [l, ***", ■ ■ • , e^-^-f , (7) 

where K is the Rician K-factor. The phase delay p ijTl is calculated by [14, chap. 4] 

p it n = n cos((f)i, n ) sin(0j, n ), (8) 

where in and 9 i>n represent the elevation and azimuth angles to the ith ground node. In terms 
of the UAV and user node positions, these quantities can be calculated as 



\Xu.n ■Ei,n) "r \yu,n Vi.n) 
COS' " 



_■ 



sm(8 iy n) = cos(5 n - e i)n ), (9) 

where 5 n is the heading angle of the UAV, 5 n — €i >n denotes the angle between the UAV heading 
and the LOS to user i, and 

r 

S,i,n; Vi,n Vu,n i— U anQ %ijn •Eu,n _ U, 

Q >n + 2tt, otherwise. 
Q, n = arctan I — — 
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Since there is little multipath scattering near the UAV, any Rayleigh fading components will 
experience high spatial correlation at the receive end of the link. Thus, we model the spatial 
correlated Rayleigh component as 



i 



2 — (R,)^^, (10) 

where g in G C Mxl has i.i.d. zero-mean, unit-variance complex Gaussian entries (which we 
denote by C/V(0, 1)), and R r is the spatial correlation matrix of the channel on the receiver 
side of the link. In [15J, a model for R r is proposed under the assumption that the multipah 
rays are distributed normally in two dimensions around the angle from the source with standard 
deviation a r , assuming a ULA receiver. We can easily extend this model to take into account 
the third dimension corresponding to the elevation angle, and the resulting R r is given by 

where denotes the Hadamard (element- wise) product, and 

The resulting distribution for h^ n is thus 

h^CJvYh^-j^RA (12) 

For the remainder of the paper, we will use the channel model defined by the LOS component 
in CO) and the Rayleigh component in (fl"2~)) . which implies a UAV equipped with a ULA. The 
ULA could be oriented along either the fuselage or the wings of the UAV, the only difference 
being a 90° change in how we define the heading angle. Extensions of the algorithm and 
analysis to different array geometries would require one to use a different expression for ©, 
which is straightforward, and to derive a different spatial correlation matrix R r , which is more 
complicated. 

III. Results for the Static Two-User Case 

To demonstrate the significant impact of the UAV trajectory on the performance of the ground- 
to-air uplink, we first consider a simple two user scenario. The gross behavior of the UAV would 
be governed by the distance D between the two users, with three possibilities: 
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1) D 3> h u - This is not a particularly useful scenario for a simultaneous uplink from both 
users since, if the UAV flies near their midpoint, both users would experience low SINR 
at the UAV due to path loss, and the sum data rate would be quite low. In this case, a 
better approach would likely involve the UAV serving each ground node separately, circling 
directly above each user and alternately flying between them. 

2) D <^ h u - This case is also less interesting since the UAV should obviously fly directly 
above the two users in as tight a pattern as possible to minimize path loss. The effect of 
the UAV heading would be minimal, since the AoAs to the two users would be nearly 
identical. If the i^-factor of the channel was high (as one would expect when the UAV is 
essentially directly overhead), then the channels would be highly correlated and a TDMA 
solution would likely be preferred over SDMA. 

3) D = 0(h u ) - Since the users transmit with the same power and their channels have the 
same statistical properties, equalizing the average uplink rates for the two users would 
require the UAV to fly a symmetric trajectory centered around the midpoint of the two 
users. If it was desired to minimize the variation in each user's average uplink rate, the 
bounds of this trajectory would be small relative to the distance to the users. This is the 
case we consider in this section. 

To make the analysis tractable, we focus on a rectangular trajectory as depicted in Fig. [Q 
defined by the side lengths C a and Cb and the orientation 5. The angle 5 is defined to be with 
respect to the side of the rectangle with greater length. Given the assumptions for scenario (3) 
above, the side lengths are assumed to satisfy max{C a , Cb} < C max <C dj, so the figure is not 
to scale. Under this assumption, the performance of a rectangular trajectory is expected to be 
similar to that for other trajectories with similar size and orientation (e.g., an ellipse or figure-8 
pattern). We also assume that mm{C a , Cb} > C mm , which effectively accounts for the turning 
radius of the UAV. 

The sum data rate at the UAV averaged along the trajectory is given by 

R = E {log 2 (l + SINRJ + log 2 (l + SINR 2 )} 

= oin T n \ I ^ log 2( 1 + SINR 1 (p)) + log 2 (l + SINR 2 (p))) dp, (13) 

Z{U a + U b J J c 
April 6, 2012 DRAFT 



where C denotes the rectangular path followed by the UAV, variable p denotes different positions 
along the trajectory and dp represents the length of the elementary subintervals along the 
trajectory. The optimization problem we wish to solve is formulated as 

max R (14) 

<5,C a ,C b 

7T 

subject to < o < — 

(-"mm <: ^b Sl ^a S: ^max 

where the symmetry of the problem allows us to restrict attention to < 5 < n/2 and assume 

Cb < C a without loss of generality. This non-linear optimization problem is difficult to solve 

directly. In the appendix, we show that for high SNR (-J-^ 3> 1) and assuming channels with 

a large i^-factor, the solution to (fT4"l) is approximately given by C a = C max , C 6 = C min and 

R c sm 2 (Mircos((j)')cos(5)) 1 sm 2 (M7rcos((p')sm(5)) 

o<<5<tt/2 l + R c sin 2 (7rcos(0')cos(<5)) 1 + R C sin 2 (7rcos(0') sin(<5)) 

where R c = ^p 62 - and <p is the elevation angle to the two users at the center of the rectangle in 

Fig. [TJ and satisfies 

COS(0 ) 



Minimizing (fT5l) can be achieved by a simple line search over the interval [0, tt/2]. 

To illustrate the validity of the approximate solution, we compare the average system sum 
rate achieved by maximizing (fT4l) using an exhaustive search over {C a , Cb} for each value of 
S evaluated in the approximate line search of (TT5T) . The simulation parameters were d\ — di — 
1500m, h u = 350m, C mm = 200m, C max = 800m, and -^ = 65dB. The results of the simulation 
are plotted in Fig. |2l which shows the best rate obtained by (fl4)) for each value of 5, and 
the optimal value obtained from minimizing (TT5T) for M = 2 and M = 4. In both cases, the 
approximate approach of (fT5l) finds a trajectory orientation that yields a near-optimal uplink rate. 
Fig. [2] also illustrates the benefit of increasing the number of antennas at the UAV, and that proper 
choice of the UAV heading can have a very large impact on communications performance. 

IV. Heading Optimization for a Mobile Ground Network 

In this section we consider a more general scenario in which several mobile ground nodes 
are present and the UAV tracks their movement. We will consider both SDMA and TDMA 
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approaches. In the SDMA scheme, all of the ground nodes are transmitting simultaneously and 
the UAV uses beamforming for source separation. For the TDMA method, each user is allocated 
an equal time slot for data transmission. It is assumed that at time step n — 1 all of the users 
feedback their current position to the UAV, and these data are used to predict the positions at 
time n. An adaptive heading is proposed that calculates the UAV heading at time step n — 1 so 
that the network's performance at time step n will be optimized. 



A. Mobility Model and Position Prediction 

We adopt a first-order auto-regressive (AR) model for the dynamics of the ground-based nodes 
lfT6l . and we assume the nodes provide their location to the UAVs at each time step. The UAV 
in turn uses a Kalman filter to predict the positions of the nodes at the next time step. We define 
the dynamic state of user i at time step n — 1 as: 



s i,n-l — [%i,n-l, Vi,n—1, v i ,n-l> v i,n-l\ ' 



(16) 



where vf n _ 1 , v v in _ 1 denote the velocities in the x direction and y direction respectively. According 
to the AR model, the state of node i at time step n is given by 



TSj.„_i + Wi n 



(17) 



(18) 



10 At 
01 At 
00 1 
1 

where w in ~ A/"(0, o^Li) represents a process noise term. Due to the effects of delay, quan- 
tization and possible decoding errors, the UAVs knowledge of the ground nodes' position is 
imprecise. This effect is described by the measurement model for user i's position: 



(19) 
(20) 



1000 
0100 

where Uj n ~ A/"(0, ct^I 2 ) represents the observation noise. We assume a standard implementation 
of the Kalman filter, as follows: 
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Initialization 



x «,o — Fs^o, Pj,o 



00 
00 



(21) 



Prediction 



°j,ra|n— 1 J- °j,n— l\n— 1; \A^) 

Pj,n|n-1 — TPj n _i| n _iT + (J w l4- (23) 



Kalman gain 



Measurement update 



K i>n = P J , n | n _ 1 F T (FP i , n | n „ 1 F T + crlh)- 1 . (24) 

^i,n\n °i,n|n— 1 ~r *-^i,n\Z'i,n " ^i,n\n—l) j V-^-'/ 



B. SDMA Scenario 

The average sum rate of the uplink network can be approximated by a reasonably tight upper 
bound 

N 



C n = J2 E { lo ^ + SINR l , n )} 



N 

< J2 !og 2 (l + EiSINRi^}") ■ (27) 

i=i 

The UAV heading 5 n will impact C n in two ways. First, it will change the distance between the 
user nodes and the UAV during time step n, which will impact the received power. Second, and 
often most importantly, changes in the heading will modify the AoA of the LOS component, 
which impacts the ability of the beamformer to spatially separate the users. At time step n — 1, 
based on the noisy observation Zj jTl _i, the UAV uses the Kalman filter to predict (xi jTl ,yi,n) an d 
hence E{S I N R in } . The heading optimization problem can thus be formulated as 

N 

max V log 2 (1 + E{SINRi, n }) (28) 

On 

«=i 
subject to \5 n — S n -i\ < AS , 
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where AS represents that maximum change in UAV heading possible for the given time step. 
The mean value of SINR i:n is calculated by 



(^hf n E{Q-i}h i;n + -^ T tr(R r E{Qr n i})^) , (29) 



E{SINR i>n } = E{P t hf n E{Q^}h,, n } 

Pt_( K r „„,„_,^ I 

a i,n , 

where tr(-) denotes the trace operator. Instead of working with the complicated term E{Q^}, 
we use instead the following lower bound based on Jensen's inequality ifTTl Lemma 4]: 

E{SINR^ n } > A UJ^h,H nE{Q , n yi^ in + _i_ tr ^ RrE | Q . n} -i^ t (30) 



i,n 

where 



We denote the lower bound on the right side of equation (|30l) as ~Ei{SINR^ n } and substitute it 
into (1281 ), leading to a related optimization problem: 

max V log 2 (l + Ei{SINRi, n }) (31) 

1=1 

subject to \S n — 5 n _i| < A5. 

Problem (|3TT) requires finding the maximum value of a single-variable function over a fixed 
interval 5„ G [£ n _i— A<5, <5 n _i+A<5], and thus can be efficiently solved using a one-dimensional 
line search. Since problem (13TT) aims at maximizing the sum rate of the system, the algorithm 
may lead to a large difference in achievable rates between the users. As an alternative, we may 
wish to guarantee fairness among the users using, for example, the proportional fair method [18J: 

N 

max V Wi>n log 2 (1 + EASING}) (32) 

On 

%=\ 
subject to \S n — S n -i\ < AS, 

where w itn oc R i:n and R itn is user i's average data rate: 

.. n— 1 

Ri,n = 7 J2 E{log 2 (l + SINR hk )} . 

n — 1 *— ' 
fe=i 

Based on our experience simulating the behavior of the algorithms described in (13TT) and (|32l) . 
we propose two simple refinements that eliminate undesirable UAV behavior. First, to avoid the 
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UAV frequently flying back and forth between the user nodes in an attempt to promote fairness, 
the weights w ijn in (1321) are only updated every N w time steps rather than for every n. Second, 
we expect that the optimal position of the UAV should not stray too far from the center of 
gravity (CoG) of the ground nodes. This would not be the case if the users were clustered into 
very widely separated groups, but such a scenario would likely warrant the UAV serving the 
groups individually anyway. To prevent the UAV from straying too far from the CoG, at each 
time step the UAV checks to see if the calculated heading would put it outside a certain range 
(i max from the CoG. If so, instead of using the calculated value, it chooses a heading that points 
towards the CoG (or as close to this heading as possible subject to the turning radius constraint). 
Appropriate values for N w and <i max are found empirically. 

The proposed adaptive heading algorithm is summarized in the following steps: 

1) Use the Kalman filter to predict the user positions (x ijn ,y itn ) based on the noisy observa- 
tions at time step n — 1, and construct the objective function in (1311) or (|32l) based on the 
predicted positions. 

2) Use a line search to find the solution of (f3TT) or (1321) for S n G [0, 27r], and denote the 
solution as S n . Calculate the heading interval O n = [S n -i — AS, S n -i+AS]. If S n E O n , set 
S n = S n , else set S n = argmin|<5 — S n \, where S = 5 n -i — AS or 6 n -i+A8. 

5 

3) Check to see if the calculated heading S n will place the UAV at a distance of d max or 
greater from the predicted CoG of the users. If so, set S n = 5 g , where S g is the heading 
angle corresponding to the CoG, or set S n = argmin|5 — 5 g \, where 5 = S n -i — AS or 

5 

5^+ AS. 

4) UAV flies with heading S n during time step n. 

Note that the line search in step 2 is over [0, 2-k] rather than just [5„_i— AS, S n -±+AS], and the 
boundary point closest to the unconstrained maximum is chosen rather than the boundary with 
the maximum predicted rate. Thus, the algorithm may temporarily choose a lower overall rate 
in pursuit of the global optimum, although this scenario is uncommon. 
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C. TDMA Scenario 

In the TDMA scenario, each node is assigned one time slot for data transmission. After 
maximum ratio combining at the receiver, the signal-to-noise ratio (SNR) of user i is given by 

SNR hn = ^\\h hn \\ 2 , (33) 

whose mean can be calculated as 

®{SNR hn } = Mf. (34) 



For the TDMA scenario, the optimization problem is formulated as 

maxlg^ n log 2 (l + ^ (35) 

subject to \S n — 5 n _i| < AS. 

where 

{1 max sum rate, 
_ 
oc Ri proportional fair. 

The objective function in (1351) can be substituted in step 2 of the adaptive heading algorithm to 
implement the TDMA approach. 

V. Asymptotically Approximate Heading Algorithms 



Under certain conditions, we can eliminate the need for the bound in (1301) when defining our 
adaptive heading control algorithm and simplify the algorithm implementation. In this section, 
we explore the asymptotic form of SINR in under both low and high SNR conditions. We show 
that in the low-SNR case, the optimal heading can be found in closed-form, without the need 
for a line search. In the high-SNR case, we show that maximizing the sum rate is equivalent 
to minimizing the sum of the users channel correlations, which can be achieved by checking a 
finite set of candidate headings. In Section [VH we show that the simpler asymptotic algorithms 
derived here provide performance essentially identical to the line-search algorithm of the previous 
section. Our discussion here will focus on the max-sum-rate case for SDMA; extensions to the 
proportional fair and TDMA cases are straightforward. 
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A. Asymptotic Analysis for Low SNR Case 

For low SNR ^ a2 <C 1, the average sum rate in (1271) is approximated by 



N 



i 

and problem (|3TT) can be rewritten as follows 

N 

max J2 E i SINR i,n} (37) 

i 

subject to \S n — <5„_i| < AS. 
In this case we can approximate Q~^ with the first order Neumann series |[T9l Theorem 4.20]: 

QS^^flM- £ ^Knhfnj. (38) 

Substituting (|38|) into ©, the SINR i)n for low SNR can be further expressed as 

Pt. 






hfnf 1 */- E p h i.« h f») V. (39) 



SINR 

a 



and we have 



E{SINR hn } = E\^Jl M - J2 ^Vhfnjh, 

P / K .-„ /. A P / A' , .-„ 1 



d 2 «a 2 U + l 4,n V ^ d 2a n a 2 \K + 1 J ' n J> AT + 1 " 



fi " '«- £ 5ST3 (^zrMJ. + 7?TT R fi 



*-i,n 



+ 






AT , v 

M Pt f ^ Pt ,-ff- ,->\ 

*^[ M - E ^l h fA,n! 2 , (40) 

where (a) is based on the assumption of a large Rician factor K for the ground-to-air channel. 
When scaled by -*$ 2 <C 1, the term involving |h^hj n | 2 in the above equation plays a minor role 
in determining the value of E {S I N R ijU } . Assuming AS and the ratio -j— are small enough, we 
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treat |h^ n h jn | as a constant when 5 n varies in [6 n -i — A5, 5 n -i + A5]. We approximate |h^ n h J)n | 



as 



Ih^h \m\h' H h'- 

\ lL i,n l, -J,n\ ~ \ l H,n ll ],n\ 



sm 



^r(cos(0- n )cos((5 n _i-e- :n )-cos(0^ n )cos(5 n _i-ej > ))j 



(41) 



sin (f (cos(0;j cos((5 n _i-e; n )-cos(0^ > ) cos(<J„_i-e^J) 

where ^ n and e^ n are calculated assuming the user nodes are located at (xi >n , y iyn ) and the UAV 
is at (x u , n _i,y U) n_i, /i u ) with heading 5„_i. The idea here is to use the UAV's position at time 
step n — 1 to calculate the users' AoA at time step n. Moreover, i- can be approximated in 

a i,n 

the following way 



-j2^ = ( 0«,n-i + « cos 5 n - x iyTl ) 2 + (y„, n _i + v sin <5 n - y^,) 2 + h 2 

= ((x Ujn -i ~ X iy7l ) 2 + (y u , n -l ~ 1Ji,n) 2 + V 2 + hr 2 + 2{x u , n -\ - Xi, n )v COs{8 n ) 

+2(y U)n _i - y ijTl )v sm.(8 n 
~ di, n - b i)n cos(<5„) - Ci tTl sin(5„), 
where a iyTl , b iyn and c iyn are defined as follows 

<H,n = ((Xu,n-1 ~ X iy n) 2 + (y u ,n-l ~ Vi,n) 2 + V 2 + hr 2 

/ \ -(a+1) 

6i,„ = 2av[x u .n-\ - x it n) f (x u>n _i - x iyTl ) 2 + (y u , n -i - y iyn ) 2 + w 2 + /ir 2 J 

/ \-(a+l) 

c i>n = 2av(y Uin - 1 - y i>n ) f (x u , n -i - ^,n) 2 + (y«,n-i - 2/;,n) 2 + f 2 + ^r 2 J 
Substituting (14TT) and (1421) into ([40]) . C n can be approximated as 

P t N fPtV - N ( 

{.Q'i,nDj,n~i~Oi,nQ'j,n) COS^O^J (,<2j,nCj,n~rCi,n'%,riJ Sin^O n J 



(42) 



ji n 



nl ^i,n^j,n 



^Ihn 



MP t N ( P t \ 2 N N 

~ ( ~^ ) 5Z 5Z \^i%^j,n\ 2 ( a i,nhn + 6 .,« a j,n) I COs(<5 n ) - —^ ^ 
^ ' i=l j=lj& J \ ° i=l 



( / .. 



a 



2 JV AT 



5Z S l h i,n h i 1 n| 2 ( a i,nC J - I n + Ci I „a Afl ) ) Sin(<J„) 



(43) 



i=l j = l,j^i 
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Define the first two terms in (|43l) as A n , and the term multiplying cos(S n ) and sin(<5 n ) as B Ti 
and D n , respectively. Then (|43l) can be further expressed as 



C n = A n - y/B* + Dlcos(6 n - Vn), (44) 

where 

{arctan I — - I if B n > 0, 

\ B nJ 
arctan I — - I + it otherwise. 

\ B nJ 

From this expression, we see that the average sum rate C n can be written as a sinusoidal function 
of S n , and the maximizing heading S n is given by 

<5* = mod 27r On + 71"). (45) 

As a result, for low-SNR, the following closed-form approximation to problem (1371) can be used: 

K Sn-i -AS<S* n < 5„_i + AS 

S n =-- I <J„_i - AS mod^(|5 n _! - AS - S* n \) < mod ff (|«J n _i + A<5 - <£|) (46) 

5 n _i + A<J mod^l^! - A6 - 5* n \) > mod ff (|5 n _i + A5 - <£|) . 

5. Asymptotic Analysis for High SNR Case 

In the high SNR case where -Jr 2 ^ 1> the average sum rate maximization problem can be 
approximated as 

N 

max T\E{SINR itn } (47) 

On 

subject to |# n — <5n_i| < AS. 
Here, when J} 2 » 1, we approximate Q^ as follows: 

i,n 



-1 



Im - — Hj jn Dj jn I Ijif H — ^H in Hj in Dj in 1 H i>n 






(c) 1 

~ a 2 



f Im - H in (H^ n H iin ) H^ n J , (48) 
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where (b) is due to the matrix inversion lemma, (c) is due to the approximation (l M + ||Hf^Hj in D i>n ) 
(£H&H iiB D iiB )-\ and 

J^_ _L 1_ J_ 

^ u l,n a i-l,n a i+l,n a N,n 

Hj )T i = [hi )T i • • • hj_x, n hj +1) „ • • • h/v,n] 
are formed by eliminating the terms for user i. Plugging (1481) into ([3]), we obtain 

SINR hn « -A_ ( h f n h i>n - ||hf n H, n (Hf„H lin )- 1 Hf„|| 2 ) , (49) 

For large i^-factor channels we ignore the contribution of the Rayleigh term, so that 

E{SINR hn } » -^L (M - ||hf B H ilB (Hf B H ll »)" 1 Hf„ir) , (50) 

where Hj„ is defined similarly to H in . Thus, the heading optimization problem can be written 

as 



m , ax II ^5-411 ( M ~ ll £ 5.Hi,n(Hf„H il n)" 1 Hf B || 2 ) (51) 

subject to |5 n — 5 n _i| < A5. 



At this point we make two further approximations. First, we will ignore the terms in the 
product involving l/d^ n , since d^ n will not change appreciably over one time step compared 
with the terms involving products of h» )Tl , which are angle-dependent. Second, we will make 
the assumption that the matrix Hf^Hj )n is approximately diagonal, which implies that the UAV 
attempts to orient itself so that the correlation between the mean channel vectors for different 
users is minimized. If we then apply these two assumptions to (IFTI) . we find that the heading 
problem reduces to 



N N 
$n 



min Yl Yl l h ?« h J>l ( 52 ) 

subject to \5 n — <5 n -i| < A<5 , 

which is consistent with the assumption of minimizing inter-user channel correlation. 

In Fig. [3l we show a plot of |hf^hj jn | for M = 4 as a function of the difference in AoA 
between the two users (variable x in the plot). It is clear that |hf^hj jn | is a piecewise concave 
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function. Since a sum of concave functions is also concave, the criterion in (1521) is piecewise 
concave as well. Since the minimum of a concave function must be located at the boundary of its 
domain, to find the solution to (1521 it is enough to evaluate the criterion at the boundary points 
{S n -i — AS, 8 n -\ + A<5} and the zero points of |h^ n hj >n | located within [8 n -i — AS, S n ^\ + AS]. 
To find the zero locations, we use the fact that a piecewise quadratic approximation to |h^ n h,, n | 
is very accurate (as depicted in Fig. [2]). When AS is not too large, the phase term p i>n in CD) 
satisfies 

p i>n « 7rcos(0- )n ) fcos(e- n - S n -i) + sin(e-„ - 8 n -x)(8 n - 5 n _i)J = e ijn + f i>n x, (53) 

where x = S n - 5 n - lf e ijn = vr cos(0-J cos(e- n - <5 n _i), f i>n = n cos((f)' i>n ) sin(e- n - £ n _i), 
x G [— A5, A5] and the calculation of <fi' in and e- follows (|4T|) . Based on (l53l) . we obtain 

I "2" ^lJi,B Jj,n)% T" Gj,n ^j,n) 



\h H h I « 



I 2 Vl/i," Jj,n)^ ~r *^i,n ^j,n) 



(54) 



Then the zero points of |hf n hj n | in terms of x are approximately given b 



v 



,. ; __ 2kii/M - e i>n + e j )U 

Ii,n Jj,n 



^^ . , ^ k = ±l,...,±2M-l. (55) 



Finally, the asymptotic solution to problem (1521) can be written as 

N N 

8 n = argmin V V |hf n h i>n |, 5 n e (4 J 6 [-AS, AS]} U {5 n _i - AS, 6 n -i + A5}. (56) 

i=i j=i+i 

VI. Simulation Results 

A simulation example involving a UAV with a 4-element ULA and four user nodes was carried 
out to test the performance of the proposed algorithm. The time between UAV heading updates 
was set to At = Is, and the simulation was conducted over L = 300 steps. In the simulation, we 
assume the users have the same initial velocity, and then move independently according to the 
model described earlier. The initial velocity of the nodes is lOm/s, and their initial positions in 
meters are (0, 25), (240, 20), (610, 30), (1240, 20). The elements of the process and measurement 
noise vectors are assumed to be independent with variances given by a 2 w = 0.5 and a\ = 0.1, 

'Where we assume AS < 1, \(fi, n — fj,n)x + ei, n — ej,„\ < 4-7T and we only consider the zero points in [— 47r,47r]. 
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respectively. The user's transmit power is set to -^ = 45dB and the path loss exponent is 
a — 1. When L = 150, all the nodes make a sharp turn and change their velocity according 
to ^fiso/^iso = —1-8856. The initial position of the UAV is (£ u ,o, 2/«,o) = (50, 100)m and its 
altitude is assumed to be h u = 350m. The speed of the UAV is v u = 50m/s, and the maximum 
heading angle change is set to be either AS = | or | depending on the case considered. The 
angle spread factor in ([111) is set to a^ = 0.05. For the proportional fair case, N w is set to 4 and 
for the high SNR case, c? max is set to 300m. 

Figs. |U|7] show the trajectories of the UAV and mobile nodes for the SDMA and the TDMA 
scenarios assuming either max-sum or proportional fair objective functions and AS = |. The 
decision-making behavior of the UAV is evident from its ability to appropriately track the nodes 
as they dynamically change position. Due to the relatively high speed of the UAV, loop maneuvers 
are necessary to maintain an optimal position for the uplink communications signals. In the 
proportional-fair approach, the UAV tends to visit the nodes in turn, while the max-sum rate 
algorithm leads to the UAV approximately tracking the area where the user node density is 
highest. Note that in this example the proportional-fair algorithm only suffers a slight degradation 
in overall sum rate compared with the max-sum rate approach. 

Figs. [8]|9] show the ergodic sum rate for the different scenarios. For each time step, the rate 
is calculated by averaging over 1000 independent channel realizations. Results for both AS = | 
and I are plotted. Increasing the maximum turning rate will clearly provide better performance 
since it decreases the extra distance that must be flown to complete a loop maneuver and the 
amount of time that the array is aligned with the angle-of-arrival of each user's signal (where 
the ability of the array to suppress interference is minimized). The benefit of using SDMA is 
also apparent from Figs. [HHH where we see that a rate gain of approximately a factor of 3.3 is 
achieved over the TDMA scheme. We also note that the obtained sum rate is only about 15% 
less than what would be achieved assuming no interference, indicating the effectiveness of the 
beamforming algorithm. 

Fig. [TO] compares the average sum rate of the line-search algorithm in (I3TI) with both the 
low- and high-SNR approximations derived in the previous section. The performance is plotted 
as a function of the received SNR that would be observed at the UAV from a ground node 
located at a distance of 1km. Although the approximate algorithms were derived separately 
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under different SNR assumptions, both of them yield performance essentially identical to (1311 ) 
over all SNR values. Each approximate algorithm is slightly better than the other in its respective 
SNR regime, but the performance difference is small. 

VII. Conclusion 

We have investigated the problem of positioning a multiple-antenna UAV for enhanced uplink 
communications from multiple ground-based users. We studied the optimal UAV trajectory for 
a case involving two static users, and derived an approximate method for finding this trajectory 
that only requires a simple line search. For the case of a network of mobile ground users, an 
adaptive heading algorithm was proposed that uses predictions of the user terminal positions 
and beamforming at the UAV to maximize SINR at each time step. Two kinds of optimization 
problems were considered, one that maximizes a lower bound on the average uplink sum rate 
and one that guarantees fairness among the users using the proportional fair method. Simulation 
results indicate the effectiveness of the algorithms in automatically generating a suitable UAV 
heading for the uplink network, and demonstrate the benefit of using SDMA over TDMA in 
achieving the best throughput performance. We also derived approximate solutions to the UAV 
heading problem for low- and high-SNR scenarios; the approximations allow for a closed-form 
solution instead of a line search, but still provide near-optimal performance in their respective 
domains. 

Appendix A 
Derivation of UAV Trajectory for Two-User Case 

In this appendix, we find an approximation to the problem posed in equation CHI): 

max R (57) 

S,C a ,Cb 

TV 

subject to < 5 < — 

c < c < r 1 < c 

where R is defined in (fl"3l) . To begin with, we observe that, due to the symmetric trajectory 
centered at the midpoint between the two ground nodes, the expected data rate averaged over 
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the trajectory will be the same for both users: 

/log 2 (l + SINR^dp = /log 2 (l + SINR 2 (p))dp . 
Jc Jc 

Thus, we can focus on evaluating the SINR for just one of the users. For large K, we can 
ignore the Rayleigh component of the channel, and assume that h- ps hj. We replace the explicit 
dependence of the channel on n with an implicit dependence on a point p along the trajectory 
defined in Fig. [Q At point p, the SINR for user 1 can be expressed as 

SINR, = -^hf (a 2 I M + ^h 2 hA In 



rnr |2 



MP t P t 2 |hfh : 



where 



hfh 2 



<a 2 «a 4 l + |£' 



sin (Me ( cos(0i) sin(0i) - cos(0 2 ) sin(0 2 )) 



(58) 



(59) 



sin ( | ( cos(0i) sin^i) — cos(0 2 ) sin(6' 2 )) 

and cos(0j) and sin(6'i) are defined in ©. Note that in addition to hi, the parameters di, 4>i and 
6i all implicitly depend on p. 

Using Jensen's inequality, the following upper bound for R can be found: 

R < log 2 (l + EiSINR^) + log 2 (l + E{SINR 2 )}. (60) 

We will proceed assuming that an operating point that maximizes the upper bound will also 
approximately optimize R. Based on (|58l) and assuming we have a high SNR scenario where 



At ^> 1 



d?(T 2 



W} g>{| 



\U H U I 2 

l n i n 2| 



«, p, ( m _m\WY. (61) 



d«a 2 V M 

where (d) is due to the high SNR assumption and (e) follows from the assumption that C max <C 
d\. The dependence of SINRi on d 2 is thus eliminated, and in what follows we drop the 
subscript on d\ and write it simply as d. 
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Substituting equation ( |6T| ) in (|60l ), and replacing the objective function in problem (PT41) with 
the upper bound of (|6Q|) . our optimization problem is approximately given by 

5S log2 1 1 + ^ - mm ) m 

7T 

subject to < o < — 

Since the objective function in (|62l) is monotonically decreasing with E{|h^h 2 | 2 }, an equivalent 
problem is formulated as 

min E{|hfh 2 | 2 } (63) 

o,C a ,C b 

IX 

subject to < 5 < — 

^min S (^b ^ ^a ^ L"max- 

The interpretation of (l63l) is that the optimal trajectory minimizes the average correlation between 
the two users' channels. 

The calculation of E{|hf / h 2 | 2 } includes the integral of the function 

sin 2 te(cos(0i) sin(0i) - cos(0 2 ) sin(0 2 )) 



sin 2 1 1 ( cos(0i) sin(^i) — cos(0 2 ) sin(6 l 2 )) 

with respect to p, which is difficult to evaluate. To simplify (fl4)) . we assume that, compared with 
the distance to the users on the ground, the UAV moves over a small region, and for purposes 
of analyzing the mathematics, one can assume that the UAV essentially remains fixed at the 
midpoint between the two users. Only the heading of the UAV changes the uplink rate in this 
case. Under this assumption, the elevation angles <f>\, <\> 2 are constant and equal (f>i — (f>2 — 4> , 
and the azimuth angles 9\, 9 2 are piecewise constant. When UAV flies along C a , they are equal 
to 6*i and 9 2 ; when the UAV flies along C&, they are equal to 9\ + f , 9 2 + f . Note that since 
9 2 = 9i + tt always holds, then sin(6 l 2 ) = — sin(#i) and we have 

H 2 sin 2 (Mtt cos)/) sin^)) 
sin [it cos(0 ) sm{9x)) 
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H 2 Sill {IVITICOS^ )COS{0)) 



Note also that 9\ + 8 = |, and hence sin(#i) = cos(<5). Thus 

sin 2 (M7r cos(0 ) cos(<5)) 
sin 2 (7r cos(0') cos(5)) 

Along C a , the UAV flies with heading 8 and along C , the UAV flies with heading 8 + ?-, so 

that cos(<5 + f ) = — sin(<5). Thus, we have 

E (|h g h| 2 |= Ca sin 2 (M7rcos(0-)cos(£)) | C b sin 2 (M7rcos(>-)sin(<5)) 
Ca + Cb sin 2 (7rcos(0.) cos(5)) C a + Cb sin 2 (7r cos (</>•) sin(5)) 



Substituting (1661) into the objective function of problem (1631) yields 

C a sin 2 (M7rcos(0;)cos(5)) C b sin 2 (M7rcos(<^) sm(8)) 

s,c a ,c b C a + C sin 2 (7rcos(<^) cos(5)) C a + C sin 2 (7r cos(<^) sin (5)) 

7T 

subject to < 5 < — 



We now show that Problem (1671) is equivalent to an optimization problem over the single 
variable 8. First define 

sin 2 (M7r cosO-) cos(<J)) 

s i = — ~ 2? 71T\ 7WT '68) 

sin (7TCOS(0J cos(ojj 

sin 2 (M7rcos(0-)sin((T)) 

S2 = ■ 2/ /^N ■ /TNN ( 69 ) 

sin (7tcos(0J sin(oj) 
i? c = ^ (70) 

R = %> (7i) 

so that 1 < R < R c . Then the objective function of (1671) can be rewritten as 

R \ s 2 — si 

:-§i + ^s 2 = Si + — . (72) 



1 + R 1 + R 1+R 

Given a heading direction 8 E [0, |], if s 2 > Si, then the objective function is minimized when 
R = R c . Otherwise, if s 2 < Si, R = 1 minimizes the objective function. The domain [0, |] can 
be divided into two sets <Si and <S 2 , such that for 8 E S x , s 2 < s 1; and for 8 E S 2 , s 2 > si. Then 
problem (1671) can be divided into two subproblems 

min — si H s 2 (73) 

subject to 8 E S 2 . 
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min -s 2 + -si (74) 

5 Z L 

subject to 5 E S\. 

Since Si(| — 5) = S2(S), for each 5 E S 2 , we have | — 8 E <Si and vice versa. Thus the following 
equation holds 

rfk SlW + ttr^ s) < l Sl{S) + ? 2W = ? 2 (i - *) + 5* (1 - ') • <75) 

Then the minimum value of (1731) must be smaller than the minimum value of (1741) and problem 
(l67l) is equivalent to problem (|73T) . For each <5 E S 2 , the following equation holds 



^^ Sl ^) + ^—s 2 (5)<^-s 2 (5)+^—s 1 (5) = ^^s 1 (--5)+^—s 2 (--5) , (76) 
1+fk u ; 1+R C v ; 1+R C v ; 1+^ v ; 1+R C V2 / l+i? c V2 /' v ' 

and problem (1731) is thus equivalent to 

m l n ifk Sl + rr^ S2 (77) 



7T 

subject to < 5 < — . 



Equation (fT5l ) follows directly from (TTTb . 
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Fig. 1. Illustration of the rectangular UAV trajectory with edge lengths C a and Ct- The angles 6\ and 62 are determined when 
the UAV is at the midpoint of the two users with heading direction S. 
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Fig. 2. Orientation of the rectangular trajectory provided by the line search method in d!5t . For the exhaustive search method, the 
solid curve and the dashed curve denote the optimal sum rate that can be achieved for different orientations S. When M = 4, the 
optimal S are: 0.66 (exhaustive search), 0.69 (line search); when M = 2, the optimal 8 are: 0.98 (exhaustive search), 1.00 (line 
search). 
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Fig. 3. Plot of Ih^hj | as a function of the AoA between the two users, along with a set of piecewise quadratic approximations. 
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Fig. 4. Trajectories of the UAV and user nodes for SDMA with AS — ?, K — 10 and -Sj = 45dB, maximizing sum rate. 
The average sum rate is: 1.8185bps/Hz. The single user data rates are ui = 0.5607, U2 = 0.6138, U3 = 0.2406, U4 = 0.4034. 
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Fig. 5. Trajectories of the UAV and user nodes for SDMA with AS = ^, K — 10 and -£j = 45dB, proportional fair. The 
average sum rate is 1.6968bps/Hz (ui = 0.4169, u 2 = 0.4084, u 3 = 0.4088, u 4 = 0.4627). 
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Fig. 6. Trajectories of the UAV and user nodes for TDMA with A5 = |-, K — 10 and |£ = 45dB, maximizing sum rate. 
The average sum rate is: 0.5294bps/Hz (ui = 0.1418, u 2 = 0.1674, u 3 = 0.0895, u 4 = 0.1307). 
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Fig. 7. Trajectories of the UAV and user nodes for TDMA with AS — ^, K — 10 and =% = 45dB, proportional fair. The 
average sum rate is: 0.5139bps/Hz (m = 0.1222, u 2 = 0.1274, u 3 = 0.1193, u 4 = 0.1450). 
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Fig. 8. Comparison of sum rate performance (bps/Hz) with K = 10 and 5| = 45dB, maximizing sum rate. The average sum 
rates are: 1.8185 (SDMA, Ad = f ), 1.7247 (SDMA, AS = f ), 0.5294 (TDMA, AS = f). 
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Fig. 9. Comparison of sum rate performance (bps/Hz) with K — 10 and -S§- = 45dB, proportional fair. The average sum rates 
are: 1.6968 (SDMA, AS = f ), 1.6042 (SDMA, AS = f ), 0.5139 (TDMA, A 5 = f). 
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Fig. 10. Comparison of the average sum rate of the line-search and closed-form approximations with AS — ^, K — 1000, 
maximizing sum rate. The x-axis denotes the SNR that would be observed at the UAV for a user node at a distance of 1km. 



April 6, 2012 



DRAFT 



